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Machine Learning 

- Grew out of work in AI 

- New capability for computers 
Examples: 

- Database mining 

Large datasets from growth of automation/web. 

E.g., Web click data, medical records, biology, engineering 

- Applications cant program by hand. 

E.g., Autonomous helicopter, handwriting recognition, most of Natural 
Language Processing (NLP), Computer Vision. 

- Self-customizing programs 

E.g., Amazon, Netflix product recommendations 

- Understanding human learning (brain, real AI). 
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Machine Learning definition 


Arthur Samuel (1959). Machine Learning: Field of study that gives 
computers the ability to learn without being explicitly 
programmed. 

Tom Mitchell (1998) Well-posed Learning Problem: A computer 
program is said to learn from experience E with respect to some 
task T and some performance measure P, if its performance on T, 
as measured by P, improves with experience E. 
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Machine learning algorithms: 

Supervised learning 
Unsupervised learning 

Others: Reinforcement learning, recommender systems. 
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Supervised Learning 
“right answers” given 
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Regression: Predict 
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Tumor Size 

only one feature or one attribute, mainly, the tumor size is used in order to predict 

whether the tumor is malignant or benign 
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You’re running a company, and you want to develop learning algorithms to address 
each of two problems. 

Problem 1: You have a large inventory of identical items. You want to predict how 
many of these items will sell over the next 3 months. 

Problem 2: You’d like software to examine individual customer accounts, and for 
each account decide if it has been hacked/compromised. 

Should you treat these as classification or as regression problems? 

Treat both as classification problems. 

Treat problem 1 as a classification problem, problem 2 as a regression 
problem. 

Treat problem 1 as a regression problem, problem 2 as a classification 
problem. 

Treat both as regression problems. 
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Supervised Learning 
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Unsupervised Learning 
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So what Google News has done is look for tens of thousands of news 
stories and automatically cluster them together. 

So, the news stories that are all about the same topic get displayed 

together. 
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Individuals 

Here's an example of DNA microarray data. 

The idea is put a group of different individuals and for each of them, you measure how 

much they do or do not have a certain gene. 

Technically you measure how much certain genes are expressed 

[Source: Daphne Roller] Dr Sherin E1Gokhy 
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Individuals 

Run a clustering algorithm to group individuals into different categories. 

So this is Unsupervised Learning because we're not telling the algorithm in advance 
that these are type 1 people, those are type 2 persons, those are type 3 persons and so. 


[Source: Daphne Koller] 
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Organize computing clusters 


Market segmer^jon 
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Social network analysis 



llmage credit: NASA/JPL-Caltech/E. Churchwell (Univ. of Wisconsin, Madison) 

Astronomical data analysis 


Of the following examples, which would you address using an 
unsupervised learning algorithm? (Check all that apply.) 


Given email labeled as spam/not spam, learn a spam filter. 

Given a set of news articles found on the web, group them 
into set of articles about the same story. 

Given a database of customer data, automatically discover market 
segments and group customers into different market segments. 

Given a dataset of patients diagnosed as either having diabetes 
or not, learn to classify new patients as having diabetes or not. 
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